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Phase Transitions on Fixed Connected Graphs 
and Random Graphs in the Presence of Noise 

Jialing Liu, Vikas Yadav, Hullas Sehgal, Joshua M. Olson, Haifeng Liu, and Nicola Elia 

Abstract 

In this paper, we study the phase transition behavior emerging from the interactions among multiple 
agents in the presence of noise. We propose a simple discrete-time model in which a group of non-mobile 
agents form either a fixed connected graph or a random graph process, and each agent, taking bipolar 
value either +1 or —1, updates its value according to its previous value and the noisy measurements of 
the values of the agents connected to it. We present proofs for the occurrence of the following phase 
transition behavior: At a noise level higher than some threshold, the system generates symmetric behavior 
(vapor or melt of magnetization) or disagreement; whereas at a noise level lower than the threshold, the 
system exhibits spontaneous symmetry breaking (solid or magnetization) or consensus. The threshold 
is found analytically. The phase transition occurs for any dimension. Finally, we demonstrate the phase 
transition behavior and all analytic results using simulations. This result may be found useful in the 
study of the collective behavior of complex systems under communication constraints. 

Index Terms 

Phase transitions, consensus, limited communication, networked dynamical systems, random graphs 

I. Introduction 

A phase transition in a system refers to the sudden change of a system property as some parameter of 
the system crosses a certain threshold value. Phase transitions have been observed in a wide variety of 
studies, such as in physics, chemistry, biology, complex systems, computer science, and random graphs, 
to list a few. It leads to long term attention in the literature, from physicists such as Ising [1] in the 
1920's to mathematicians such as Erdos and Renyi [2] in the 1960's, from complex systems theorists 
such as Langton [3] in the 1990's to control scientists such as Olfati-Saber [4] in the 2000's. 

Ising and other physicists have thoroughly studied the simple but "realistic enough" Ising model, for 
the understanding of phase transitions in magnetism, lattice gases, etc. In an Ising model, each node 
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can take one of two values, and the neighboring nodes have an energetic preference to take the same 
value, under some constraints such as a temperature one. It is observed that, for an Ising model with 
dimension at least 2, a temperature higher than a critical point leads to symmetric behavior (e.g., "melt" 
of magnetization, or vapor), whereas a temperature lower than that point leads to asymmetric behavior 
(e.g., magnetization, or liquid). The Ising model is a discrete-time discrete-state model, and is closely 
related to the Hopfield networks and cellular automata. 

Erdos and Renyi [2] showed that, graphs of sizes slightly less than a certain threshold are very 
unlikely to have some properties, whereas graphs with a few more edges are almost certain to have 
these properties. This is called a phase transition of random graphs, see for example [5]. 

Viscek et al [6] showed that a two-dimensional nonlinear model exhibits a phase transition in the 
sense of spontaneous symmetry breaking as the noise level crosses a threshold. This model consists 
of a two-dimensional square-shaped box filled with particles represented as point objects in continuous 
motion. The following assumptions are also adopted: 1) the particles are randomly distributed over the 
box initially; 2) all particles have the same absolute value of velocity; and 3) the initial headings of 
the particles are randomly distributed. Each particle updates its heading using the average of its own 
heading and the headings of all other particles within a radius r, which is called the nearest neighbor 
rule. Included for each particle in this model is a random noise (which may be viewed as measurement 
noise or actuation noise) with a uniform probability distribution on the interval [— r], rj\. The result of 
[6] is to demonstrate using simulations that a phase transition occurs when the noise level crosses a 
threshold which depends on the particle density. Below the threshold, all particles tend to align their 
headings along some direction, and above the threshold, the particles move towards different directions. 
Czirok et al [7] presented a one-dimensional model which also exhibits a phase transition for a group 
of mobile particles. These two models are discrete-time continuous-state models. 

Schweitzer et al [8] studied the spatial-temporal evolution of the populations of two species, where the 
update scheme depends nonlinearly on the local frequency of species. Depending on the probability of 
transition from one species to the other, the system evolves to either extinction of one species (agreement) 
or non-stationary co-existence or random co-existence (disagreement). 

We note that phase transition problems are sometimes associated with flocking / swarming / formation 
/ consensus / agreement problems. Though the interest and focus of these problems are often indepen- 
dent of the phase transition study, these problems typically exhibit phase transitions when parameters, 
conditions, or structures change. These problems and the phase transition problems may also share 
some common techniques in order to establish stability / instability over similar underlying models, 
such as common Lyapunov function techniques, graph theoretic techniques, and stochastic dynamical 
systems techniques. More specifically, the phase transitions occurring in flocking may be classified 
into two categories: angular phase transitions that leads to alignment (see e.g. [6]), and spatial self- 
organization in which multiple agents tend to form special patterns or structures in space, such as lattice 
type structures. Examples of the latter category include [9]-[ll]. In [9], Mogilner and Edelstein-Keshet 
investigated swarming in which the dynamical objects interacts depending on angular orientations and 
spatial positions, and a phase transition is observed. In [10], Levine et al presented a simple model 
to study spatial self-organization in flocking showing that all the agents tend to localize in a special 
pattern in one- and in two-dimensions with all-to-all communication. We refer to [4], [1 1]— [14] for 
some recent studies of phase transitions and the consensus / agreement problems over networks. Olfati- 
Saber [4] studied the consensus problem using a random rewiring algorithm (see also [15]) to connect 



nodes, and showed that the Laplacian spectrum of this network may undergo a dramatic shift, which is 
referred to as a spectral phase transition and leads to extremely fast convergence to the consensus value. 
In [16], Hatano and Mesbahi established agreement of multiple agents over a network that forms an 
Erdos random graph process, in which each agent updates its state linearly according to the perfect state 
information of its nearest neighbors. Hatano and Mesbahi also studied another facet of the distributed 
agreement problem in the stochastic setting in [14], namely the agreement over noisy network that forms 
a Poisson random graph. 

Jadbabaie et al [17] provided a rigorous proof for the alignment of moving particles under the nearest 
neighbor rule without measurement noise or actuation noise. Different from the switched nonlinear model 
used in [6], the model in [17] is a switched linear model. Furthermore, this model also assumes that 
over every finite period of time the particles are jointly connected for the length of the entire interval. 
Due to the noiseless assumption made in [17], the phase transitions observed in [6] will not occur. 
Under these assumptions, Jadbabaie et al proved that the nearest neighbor rule leads to alignment of 
all particles. One may be interested in finding Lyapunov functions (preferably quadratic) to show the 
convergence or alignment (see [12], [13] for convergence proofs based on common Lyapunov functions 
for models different from [17]). However, [6] showed that a common quadratic Lyapunov function does 
not exist for this switched linear model. On the other hand, a non-quadratic Lyapunov function can be 
constructed to prove the convergence, as suggested by Megretski [18] and later independently found by 
Moreau [19]. See also [20], [21] for extension of [17]. 

In this paper, we propose a discrete-time discrete-state model in which a group of agents form either 
a fixed connected graph or a random graph process, and each agent (node) updates its value according to 
its previous value and the noisy measurements of the neighboring agent values. We prove that, when the 
noise level crosses some threshold from above, the system exhibits spontaneous symmetry breaking. We 
may view that the high noise level corresponds to high temperature (or strong thermal agitation), where 
the molecules exhibit disorder and symmetry; and the low noise level corresponds to low temperature, 
where the molecules exhibit order and asymmetry. 

We emphasize that the proposed model is rather simple and hence admits a complete mathematical 
analysis of the phase transition behavior. First, the phase transition in a fixed connected graph presented 
in this paper is simpler than the phase transition in the Ising model. As one indicator of the simplicity, 
note that the Ising model of dimension higher than two involves intractable computation complexity 
when attempting to solve for the value for each node under the temperature constraint, namely, such 
a problem is NP-complete [22]. Also the Ising model needs dimension two or higher to generate the 
phase transition, whereas our phase transition occurs for any dimension. To the best of our knowledge, 
the proposed model is one of the simplest that exhibits a phase transition in a fixed graph, and is 
mathematically provable to generate a sharp phase transition. Note that many other phase transitions 
elude rigorous mathematical analysis due to their complexity [3], [4], [6], [7], [22]. Second, the phase 
transition on a random graph is also simpler than the phase transition on a random graph observed in 
[2]. Compared with the models in [6] and [7], our models have discrete-states and do not allow the 
mobility of agents, which greatly simplifies the systems dynamics and allows rigorous proofs of the 
phase transition behavior. The simplicity of our phase transitions may help us to identify the essence of 
general phase transition phenomena. 

Our study also sheds light on the research on the consensus problems, cooperation of multiple-agent 
systems, and collective behavior of complex systems, all under communication constraints. Hence, this 



study fits into the general framework of investigating the interactions between control/dynamical systems 
and information; see e.g. [23]-[29] and references therein. More specifically, we may interpret our phase 
transition in the consensus problem framework, where the disagreement due to unreliable communication 
is replaced by agreement when the communication quality improves to a certain level. In other words, our 
work characterizes the significance of information in reaching agreement. However, unlike the average- 
consensus problem (cf. [13]) with the properties that, 1) there exists an invariant quantity during the 
evolution, and 2) the limiting behavior reaches the average of the initial states of the system, our models 
reach agreement without these properties when the noise level is low. This is because the presence of 
noise prevents the conservation of the sum of the node values during the evolution. The study of entropy 
flows (or information flow) [23], [30] may help identify an invariant quantity of the system. We remark 
that a more thorough study of the consensus problem raised in this paper is beyond the scope of this 
paper and will be pursued elsewhere. 

Organization: In Section 2 we introduce the models. In Section 3 we state our main results and 
provide the proofs. In Section 4 we present numerical examples. Finally we conclude the paper and 
discuss future research directions. 

II. Models on the graphs 

This section introduces some of the terms that are frequently used in this paper as well as the two 
models to be investigated. We focus only on undirected graphs. 

A. Graphs and random graph processes 

A graph G := (V, E) consists of a set V := {1, 2, N} of elements called vertices or nodes, and a 
set E of node pairs called edges, with E C E c := € V}. Such a graph is simple if it has no 

self loops, i.e. $ E if i = j. We consider simple graphs only. A graph G is connected if it has a 
path between each pair of distinct nodes i and j, where by a path between nodes i and j we mean a 
sequence of distinct edges of G of the form (i, ki), (k±, fo), . . . , (k m ,j) € E. Radius r from node i to 
node j means that the minimum path length, i.e., the minimum number of edges connecting i to j, is 
equal to r. 

A fixed graph G has a node set V and an edge set E that consists of fixed edges, that is, the elements 
of E are deterministic and do not change dynamically with time. 

A random graph G consists of a node set V and an edge set E := E(u), where uj € Cl, (Cl, J 7 , P) 
forms a probability space. Here Cl is the set of all possible graphs of total number of n, where 

NtN-l) 

n:=2~^; (1) 

T is the power set of Cl; and P is a probability measure that assigns a probability to every oj £ Cl. In 
this paper, we focus on the well-known Erdos random graphs [5], namely, it holds that 

P(u) = -. (2) 
n 

In other words, we can view each E(lo) as a result of N(N — l)/2 independent tosses of fair coins, 
where a head corresponds to switching on the associated edge and a tail corresponds to switching off 
the associated edge. Notice that the introduction of randomness to a graph implies that, all results for 
random graphs hold asymptotically and in a probability sense, such as "hold with probability one". 



A random graph process is a stochastic process that describes a random graph evolving with time. 
In other words, it is a sequence {G(k)}^L of random graphs (defined on a common probability space 
P)) where k is interpreted as the time index (cf. [5]). For a random graph process, the edge set 
changes with k, and we denote the edge set at time k as E(k). In this paper, we assume that the edge 
formation at time k is independent of that at time I, if k 7^ I. 

The neighborhood Ni(k) of the ith node at time A; is a set consisting of all nodes within radius 1, 
including the ith node itself. The value that a node assumes is its node value. The valence or degree of 
the ith node is (|iVj(A;)| — 1), where \Ni(k)\ denotes the number of elements in Ni(k). The adjacency 
matrix of G(k) is an N x N matrix whose (i,j)th entry is 1 if the node pair 6 E(k) and 

otherwise. Note that the graphs can model lattice systems with any dimension. 



B. System on a graph 

A system on a graph consists of a graph, fixed or forming a random process, an initial condition that 
assigns each node (agent) a node value, and an update rule of the node values. In this paper, we assume 
that each node can take value either +1 or —1, and the update rule for the ith node at the (k + l)st 
instant is given by 

Xi(k + 1) = sign [ui(fc) +&(*;)], (3) 

where £i(k) is the noise random variable, uniformly distributed in interval [—77, rj\ and independent across 
time and space and independent of the initial condition x(0), and 

that is, Vi(k) is the average of the node values in the neighborhood Ni(k). Here r\ is called the noise 
level. This update rule resembles the one in [7], with their antisymmetric function being replaced by a 
sign function. It may also be viewed as a specific update rule for a Hopfield neuron whose connections 
with others are noisy. 

The state of the system at time instant k, denoted x(k), is the collection of all node values (x±(k), • ■ ■ , xn 
The state sum at time instant k, denoted S(k), is defined as 

N 

S(k):=J2xi(k). (5) 
i=l 

With a slight abuse of notation, we represent the state with all +ls and all -Is (i.e. the consensus states) 
as +N and — N, respectively. We call a state transient if this state reappears with probability strictly 
less than one. We call a state recurrent if this state reappears with probability one. We call a state X 
absorbing if the one-step transition probability from X to X is one. 



C. Model with a fixed graph 

The first model considered is a system on a fixed graph. In this model, the node connections or 
the edges remain unchanged throughout. Hence, every node has a fixed neighborhood at all times, and 
the degree of each node as well as the adjacency matrix are constant. The node value gets updated 
according to the update rule ([3]). We will assume that the fixed graph is connected. An example of such 
a fixed graph model is a communication network with fixed nodes and fixed but noisy channels. Another 
example is a Hopfield network with fixed neurons and fixed but noisy channels connecting them. 



D. Model with a random graph process 

The second model considered is a system on a graph forming a random process. In this model, the 
node connections, namely the edges of the random graph, change dynamically throughout, and the edge 
formations at time k are random according to distribution P(k). Hence every node may have different 
neighborhoods at different times, and the adjacency matrix and degrees change with time. The node 
value gets updated also according to the update rule ([3]). An example of this model could be an ad-hoc 
sensor network in which the communication links between the sensors appear and disappear dynamically. 
Another example is an erasure network in which the communication channels are noisy and erasing with 
some probability, see for example [31]. 

In both models, the system state can take 2J values, where 

J := 2 N ' X (6) 

and the state sum takes values in the set M := {-N, -N + 2, • • • ,N-2, N}, where N > 2 is the total 
number of nodes. Note that \J\f\ = N + 1 > 3. Both models also form Markov chains, since the next 
state does not depend on previous state if the current state is given. 

We use £(k) to represent (£i (&),•■■ ,£,N(k)), £ k to represent (£(0),--- G k to represent 

(G(0), • • • , G(k)), and x(k) to represent (xi(k), ■ ■ ■ , X]y{k)). 

III. Main results and proofs 

Our main result states that, for a system on a fixed connected graph or on a graph forming a random 
process, there is a provable sharp phase transition when the noise level crosses some threshold. Here 
the phase transition is in the sense that the symmetry exhibited at high noise level is broken suddenly 
when the noise level crosses the threshold from above, or equivalently the disagreement (or disorder) 
of the nodes at high noise level becomes agreement (or order) below the threshold. In what follows, 
we first discuss the case in which the graph has a fixed structure, and then the case in which the graph 
forms a random process. 

A. Model with a fixed graph 

Proposition 1. For any given fixed connected graph, let D be the maximum number of nodes in one 
neighborhood. 

i) If the noise level is such that r] £ (1 — 2/D, 1], then the system will converge to agreement, namely 
all nodes will converge to either all +ls or all —Is. 

ii) If the noise level is such that i] > 1, then ES(k) tends to zero as k goes to infinity, i.e., the system 
will converge to disagreement in which approximately half of the nodes are +ls and the other half are 
-Is. 

Remark 1. Notice that (1 — 2/D) is guaranteed to be nonnegative for any connected graph with more 
than one node, since D > 2. Note also that if rj < (1 — 2/D), the system does not necessarily converge 
to states ±N. To see this, simply consider a one-dimensional cellular automaton with N nodes forming 
a circle. The neighborhood of a node is defined as one node to the left, one node to the right, and itself. 
Therefore D = 3, and if rj < 1/3, the update rule becomes a majority voting rule. Then the initial 
condition x(0) of the system with alternate +ls and —Is will lead to constant oscillations between x(0) 
and a left cyclic shift of x(0), i.e., it will not reach agreement if rj < 1/3. However, this does not mean 



that in general our condition 1 > 77 > (1 — 2/D) is a necessary condition for agreement; a sufficient 
and necessary condition is under current investigation. Attractors like this x(0) may be viewed as local 
attractors (whereas +N may be viewed as global attractors) which can be eliminated by considering a 
randomized graph, see the next subsection. 

The proof of Proposition [JJ needs the following lemmas. 

Lemma 1. For any given fixed connected graph, ifrjE (1 — 2/D, 1], then the states +N are absorbing, 
and all other states are transient. 

Lemma 2. For any given fixed connected graph, ifrj> 1, then the states form an ergodic Markov chain 
with a unique steady-state distribution for any initial condition x(0). 

Proof of Lemma Q} At states +N, the noise is not strong enough to flip any node value. Thus, +N 
are absorbing. On the other hand, all other states are neither absorbing nor recurrent. To see this, let 
M 7^ +N be any state, which leads to that M contains a mixture of +ls and — Is. Due to the connectivity 
of the graph, we can always find a node i with node value Xi(k) = — 1 whose neighborhood Ni(k) 
(including Xj(fc) itself) contains both +ls and —Is. Then for such Xi(k), it holds that 

\vi(k)\ < (7) 

with equality if only one node in Ni(k) has a different sign than all other nodes and if Ni(k) contains 
D nodes. Hence a noise larger than (D — 2)/D flips Xi{k). Precisely, 



= Pr 
> Pr 



Pr[x i (fe + l) = +l|a; i (A;) = -l] 
Vi(k)+&(k) > 0\ Xi (k) = -1] 

Xi{k) = -1 



m > 1 



(8) 



D 

If D-2\ 

- 2V— ) >a 

Note that the conditioning is removed due to the independence assumptions on noise. Thus, for state 
M, the probability that only Xj flips and no other node changes its value is non-zero. This follows 
that, with a positive probability the state sum for M will be increased by 2. Likewise, with a positive 
probability M can be decreased by 2. Since M ^ ±N is an arbitrary state, by induction, the probability 
of transition (in possibly multiple steps) from M to ±N is nonzero. So M is transient. 

Proof of Lemma E} It is sufficient to prove that the state forms an irreducible and aperiodic Markov 
chain. 

To see the irreducibility, note that if rj > 1, M / ±N can jump to any other states with a positive 
probability, similar to Lemma [TJ Additionally, ±A r can also jump to any other states with a positive 
probability. For state +N, it holds that 

Pr[ Xi (k + 1) = -l\xi(k) = +1, 1 = 1, ■ ■ ■ , N] 
= PT[ Vi (k)+^(k) <0\ Xl (k) = +1,1 = 1,- ■■ ,N] 

= Pr[&(fc) < -l\xi(k) = +1,1 = l,--- ,N] (9) 

= 5j0i-i)>o, 

so any node can flip its value with a positive probability. Similar result holds for state — N. Then this 
Markov chain is irreducible. 



To see the aperiodicity, let us use — xi to denote the flipped Xj. The state transition cycle from 
(x\(k),X2{k),*) to (— x\(k), — X2(k), *) to (— xi(k), x^{k), *) and back to (xi(fc), X2(&), *) has period 
3, where * is any fixed configuration for (xs(k), ■ ■ ■ , x/v(fc)). However, the state transition cycle from 
(xi(k),A) to (— xi(k), A) and back to (xi(k), A) has period 2, where A is any fixed configuration for 
(x2(k), ■ ■ ■ ,XN(k)). Note that such cycles occur with positive probabilities. Then the Markov chain is 
aperiodic. 

Proof of Proposition QJ If r/ € (1 — 2/D, 1], by Lemma [Q the associated Markov chain will converge 
to either +N or — N with probability 1, namely agreement. If rj > 1, from Lemma [2] we know that 
the associated Markov chain is ergodic, and notice that the Markov chain has a symmetric structure 
for states x and —x. Then ir(x) = tt{—x) (rigorous proof is included in Appendix), where ir(x) is the 
stationary probability of state x. Hence the expectation of state sum is 



Therefore, ES(k) converges to zero, and the numbers of +ls and —Is will asymptotically become equal. 

B. Model with a random graph process 

For an Erdos random graph, we assume that the edge connections are randomly and independently 
changing from time to time. The randomization of the connections symmetrizes the system behavior 
and leads to agreement even for an arbitrarily small but positive noise level. 

Proposition 2. Consider an Erdos random graph process. 

i) If the noise level is such that < r] < 1, then the system will converge to agreement, namely the 
state will converge to +N or —N. 

ii) If the noise level is such that 77 > 1, then ES(k) exponentially converges to zero with decay 
exponent In?] as k goes to infinity, i.e., the system will exponentially converge to disagreement in which 
about half of the node values are + Is and the other half are — Is. 

The proof of this proposition needs the following lemmas. We remark that it is straightforward to 
generalize the lemmas to a binomial random graph, in which the probability of forming an edge is 
changed from 0.5 to an arbitrary p £ (0, 1). 

Lemma 3. For any Erdos random graph process, if 77 € (0, 1], then ±N are absorbing, and all other 
states are transient. 

Lemma 4. For any Erdos random graph process, if r] > 1, then it holds that ES(k) exponentially tends 
to zero as k goes to infinity. The decay exponent is lnry. 

Proof of Lemma If < 77 < 1, it is easy to see that ±N are absorbing. For any state M ^ ±N, 
it holds that M must be a mixture of both +ls and —Is. Hence we can find i and j in V such that 
Xi(k) = —1 and Xj(k) = +1. Since each of the n graphs (recall (Q])) has a positive probability, the 
probability that x% is connected to Xj only is positive. Then in this case, Vi(k) is and hence an arbitrarily 
small but positive noise may flip Xi with a positive probability. In addition, each node other than Xj has 
a positive probability to keep its previous value, thus with a positive probability, the state sum for M 
can be increased by 2. Therefore any M 7^ ±N are transient. 




(10) 



Proof of Lemma |3l For any Erdos random graph, if 77 > 1, then no state is absorbing, since with a 
positive probability the noise can flip any node value in any configuration. Therefore, with a nonzero 
probability the state of the system can jump to any other states. 

Now let us analyze the evolution of ES(k). Fix the time to be k. Assume x(k) is given. Then for 
each i, X{(k + 1) is given by ([3]). The randomness in xi{k + 1) is due to the noise £i(k) and the graph 
G(k). It holds that 

E[xi(k + l)\x(k)] 
= Esign[vi{k) + ti(k)\x(k)] 
= Pr[vi(k) + &(k) > 0\x(k)] x (+1) 

+Pr[«i(fc) + < 0\x(k)] x (-1) 
= Pr[&(fc) > —Vi(k)\x(k)] - Pr[&(fc) < - Vi (k)\x(k)} 
= J2 > -Vi(k)\vi(k)]Pr[vi(k)\x(k)] 

Vi(k) 

- Prfe(^) < -Vi(k)\vi{k)]Pt[vi{k)\x(k)] 

Vi(k) 

~r/ + Vi(k) rj-Vi(k)' 



(11) 
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Vi(k) 



2rj 



2fj 



Vx[vi{k)\x{k)\ 



^-Pr[ Vi (k)\x(k) 



Vi{k) ^ 

= -E[ Vi (k)\x(k)}. 
rj 

Then we compute E(vi(k)\x(k)). Since conditioned on x(k), the randomness in Vi{k) comes from 
G(k) only, this expectation boils down to the expectation of the average of node values in a neighborhood, 
averaged over all possible n graph structures. Let us count in the n graph structures the number of 
different neighborhood types containing node i. Among those neighborhoods containing node i, there 
are 

rh:=2 (N-l)(N-2 ) /2 x (N-l\ (12) 

\ m I 

types of neighborhoods for which \Ni(k)\ = (m + 1) where m = 0, 1, • • • , N — 1. To see this, simply 
notice that the graph formed by nodes other than i can have any edge formation and hence the number 
of types of 2( Ar_1 )( Ar ~ 2 )/ 2 , and that node i needs to select m out of the other (N — 1) nodes in order 
to have \Ni(k) \ = (m+ 1). 



Therefore, 



E[ Vi (k)\x(k)] 

^2[ Vi (k)\x(k),G(k)]PT[G(k)] 

G(k) 

J2j£Ni(k) Xj{k) 



n 



n 



G(k) 

E 

G(k) 
1 



\Ni(k)\ 
Xi(k) 



x(k),G(k) 



(13) 



n 



E 



J2jeN t (k),j^i x j 

(k) 



Now first note that 



E 

G(k) 



G(k) 

Xi(k) 



\Ni(k)\ 



x(k),G(k) 



x(k),G{k) 



N-l 

E 

m=0 



Xj{k) 

m + 1 



in 



x(k) 



(14) 



Then note that in the summation 



E 

G(k) 



Y.j£N,(k),j^i Xj{k) 



\Ni(k)\ 



x(k),G(k) 



(15) 



each node j / i will be counted m x times for those neighborhood types such that j G Ni(k) and 
\Ni(k)\ = (m + 1), so it holds that 

J2jeNi(k),j^i Xj(k) 



E 

G(fc) 



|JVi(*)l 



7V-1 



EE 

jj^i m=0 



Xj(k) 



in 



-m- 



m + l N - 1 



x(k),G(k) 
x(k) 



Thus, we have 



where 



E[t>i(fc)|x(fc)] = ciXj(fc) + ^2 C2Xj(k), 
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This yields that, in view of (fTTT) . 
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Therefore, the expected state sum at the next time is 

E{S{k + l)) = E[E(S(k + l)\x(k))\ 

= -ES(k). 
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Since r\ > 1, the above recursion converges to zero exponentially, and the decay exponent is 
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Proof of Proposition |2t If < r\ < 1, from Lemma [3j the system state sum will converge to the 
absorbing states with probability 1. If r) > 1, from Lemma |U the system state will converge to zero 
exponentially with probability 1. 



IV. Numerical results 

Consider first a fixed one-dimensional 500-agent system. The agents are arranged along a circle and 
each agent has two neighbors. The initial value of every agent is arbitrarily assigned to be +1 or — 1. 
The simulation results demonstrate the phase transition, see Figure Q] (a) and (b). In Figure Q] (a), the 
vertical axis represents the state sum of the system, and the horizontal axis represents the simulation 
steps. Figure [T] (a) demonstrates that, when the noise level is such that 1/3 < r] < 1, then all node values 
converge to agreement of all +ls (or all —Is), that is, the state sum of the system is +500 (or -500). 
In Figure Q] (b), the vertical axis represents the time average of the state sum, and the horizontal axis is 
for the simulation steps. By ergodicity of the system, the time average should converge to the ensemble 
average of the state sum. Figure [T](b) shows that, if the noise level is such that r\ > 1, then the nodes 
reach disagreement in which about half of the node values are +ls and the other half are —Is. 
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Time (steps) Time (steps) 

(a) (b) 

Fig. 1. Fixed graph simulation, (a) Noise level is 0.75, and the system converges to agreement of all +ls. (b) Noise level is 
2, and the system reaches disagreement in which about half of the states are +ls and the other half are —Is. 

For the random graph process case, in our simulation we consider binomial random graphs. In a 
binomial random graph, each edge has a probability p to be formed at each time step and is independent 
of all other edges and other times. This means that to generate such a binomial random graph, we only 
need to generate at each step an adjacency matrix whose entries in the strictly upper triangular part are 
independent and identically distributed. The initial value of every agent is randomly assigned to be +1 
or —1 according to an arbitrary distribution. The simulation results are shown in Figure [2] (a) and (b), 
and are similar to the fixed connected graph case, except that in the random graph case, an arbitrarily 
small but positive noise level can lead to agreement. 

We can also compute the decay exponent of E5(fc) from the numerical results. To obtain the 
probability means ES(k) numerically, we can run many independent trials of the random process and 
take the average of the state sums across the trials. See Figure [3] for the simulated decay exponents (with 
different edge probability p) and the theoretic decay exponent In r], which are almost identical. 

Notice that p does not play any role in the decay exponent. The role of p is reflected in other quantities, 
such as the stationary distribution. To see this, let us consider a two-node binomial graph, i.e. N = 2, 
and compute the stationary distribution as well as the decay exponent directly based on the transition 
probability matrix. Let us first order the state values as (+1,+1), (+1,-1), (—1,-1), and (— 1,+1). 
Based on this ordering, the transition probability matrix is 
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Fig. 2. Random graph process simulation, (a) Noise level is 0.005, p = 0.1, and the system converges to agreement of all 
— Is. (b) Noise level is 2, p = 0.2, and the system reaches disagreement in which about half of the states are +ls and the 
other half are —Is. 
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Fig. 3. The simulated decay exponents (averaged over 10,000 independent trials and r\ = 1.05) and the theoretic decay 
exponent. 
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and the stationary distribution is 
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where g := (1 — p), and 
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Clearly, the edge probability p influences the stationary distribution. Now assume that the state is 

distributed according to distribution po := (p ++ ,p^ ,p )', which has the expected state sum 

as 2(p ++ — p ). Then the state at the next time is distributed as P x p and the expected state sum 

becomes 2(p ++ —p )/rj. Therefore, we have verified the dependence on p in the stationary distribution 

and the independence on p in the decay rate of the state sum. 



In this paper, we proposed simple dynamical systems models exhibiting sharp phase transitions, and 
presented complete, rigorous proofs of the phase transitions, with thresholds found analytically. Our 
analysis also provided a characterization of how information (or noise) affects the collective behavior of 
multi-agent systems, which gives an analytic explanation to the intuition that, to reach consensus, high 
quality of communication is needed. These results hold for any dimension; in contrast, phase transitions 
in the well known Ising models do not occur for dimension one, and for dimension three or higher, 
Ising models are NP complete and intractable. 

In particular, we have shown that for a fixed connected graph, if the noise level is greater than 
(1 — 2/D) and less than 1, all the agents reach agreement, i.e. the state sum of the system converges to 
±N, the only absorbing states of the system. For noise level larger than 1, the group of agents fail to 
reach any agreement; instead they reach "complete disagreement" or disorder. Thus, a phase transition 
occurs at rj = 1. For random graph processes, the system reaches agreement even for noise level smaller 
than (1 — 2/D). This is because randomization is immune to the artifacts (or local attractors) for smaller 
noise which stops fixed graphs from reaching any agreement. However, the tradeoff is that in random 
graphs, the nodes' neighbors may not be "geographically close", which might not hold true in some 
practical situations. 

Our study was concentrated on the leaderless case. The leader case is when there is a leader with a 
fixed value and it tries to convince all other agents to follow its value. Simulation obtained in this case 
suggested that a complete analysis is a bit involved especially in the high noise regime, which is subject 
to further research. Another direction could be to obtain a suitable Lyapunov function for the models. 
One advantage of doing so is that the Lyapunov function based approach may be extended to rather 
general nonlinear systems, as suggested by [18], [19]. The Lyapunov function is preferably a quadratic 
one, leading to mean-squre stability, which is stronger than the mean stability obtained in this paper. The 
applications of our approach and results are also subject to future research, including the extension of our 
approach to more realistic models; note that our models in this paper are simple and not quite realistic, 
though the simplicity helped us to completely characterize the phase transition. We will also explore the 
connections of our model to relevant models, e.g. the Ising models, Hopfield networks, cellular automata, 
other random graphs, etc. Finally, we remark that the approach and results developed in this paper may 



V. Conclusions and future work 



be found useful to study more general dynamical systems under communication constraints, such as 
cooperation with limited communication, complex systems in the presence of noise, etc. The study of 
such problems would help establish insights on how information (or limited information) interacts with 
system dynamics to generate various types of interesting system behavior. 

Appendix 

We prove that ir(x) = ir{—x) for any x in four steps. 

Step 1: Establish a one-to-one mapping between the 2 J possible values (see ©) that the state of 
the system can take and integers ±1, ±2, • • • , ±J, such that if state x is mapped to +j, then state — x 
is mapped to —j. Now aggregate the states as follows. Let j := (j, — j) for any j = 1, • • • , J. Then 
we induce from the Markov process {x(k)}^L another Markov process {x(k)}^L , where the latter 
is defined on the induced state space consisting of all js. Note that it is straightforward to verify that 
{xfc}^ forms a Markov process on the induced state space, and this Markov process is ergodic. 

Step 2: Denote the transition probability matrix for process {x(/c)}^ as p, and the corresponding 
stationary distribution vector as n := (ff (1) , ff (2), 7f( J))'. Then it holds that 7f = p7t. By ergodicity, 
7f is non-zero and unique (i.e., the matrix (/ — p) must be rank deficient). 

Step 3: For the Markov process {x(k)}^ =0 , denote the stationary distribution vector as 7r := (tv^, n^)', 
where 7ri = (7r(+l), tt(+2), 7r(+ J))' and tt 2 = (ir(—l), tt(— 2), 7r(— J))' . It can be verified that, by 
the symmetry that the state transition i — > j has the same probability as the state transition (— i) — > (—j), 
the transition probability matrix has the following particular form: 

p:= ( A ba)- (26) 

Step 4: By ergodicity of {x(k)}^ =0 , it holds that 

7T = pir (27) 

or equivalently, 

ni = A *i + B «* (28) 

7T 2 = BtTi+AtT 2 . 

However, it can be easily seen that p = A + B. Notice that 

7Tl = 7T2 = Vf (29) 

solves (|28T ). i.e., ttq := solves (T27T ) and is non-zero. By ergodicity, the non-zero solution is 

unique, and hence ttq must be the solution to (1271 ). which follows that ir(j) = ir(—j) for any j or 
7r(x) = 7r(— x) for any x. 
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